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Spinal TAP 


* Regression Testing and lest Driven 
Development. 


* Why Automate”? 

* The Testing Anything Protocol (TAP) 
* Spinal TAP API 

* TAP Extensions 


e SpinalTAP Utilities 


Regression Testing and Test 
Driven Development 


* A software testing method which seeks to 
insure that new bugs were not introduced 
when making a change 


* Include eXtreme Programming (XP), Agile, 
Test-Driven Development (TDD), ... 


e Write tests first 


* Automate and summarize 


Why Automate”? 


* More than 50% of a projects life-cycles is in 
debugging and testing 


* Bug fixes take 33 to 40 times as long 


e Additional 15% to 30% investment results 
in 40% to 90% reduction in defect density 


e Test suite itself is an asset 


The Testing Anything Protocol 
(TAP) 


* Developed by Larry Wall in the mid 80's for 
Perl language 


* Separation of Producers and Consumers 
* Simple 


* No formal specification 


TAP stream example: 


Optional: TAP version 13 
Required: 1..3 
# some diagnostic 
Ok 1 - Input file opened 
Ok 2 - First line of the input valid 
not ok 3 - Read the rest of the file # TODO reason 


Example TAP Summary 


Test Summary Report 
t/iterators.t (Tests: 92 Failed: 8) 
Failed tests: 7-13, 15 
t/nofork-mux.t (Tests: 6 Failed: 0) 
t/regression.t (Tests: 4794 Failed: 103) 
Failed tests: 2, 5, 31, 34, 58, 61, 85, 88, 114, 118, 145-146, 
171-172, 200-201, 226-227, 252, 255, 278-279, 
308, 312, 338, 342, 368-369, 395-396, 422, 
425, 452, 454-455, 481, 484, 509-510, 538-539, 
563, 567, 593, 597, 623, 627, 653, 657, 683-684, 
686, 690, 716, 720, 746, 749, 775-776, 803-804, 
831-832, 835-837, 866, 870, 896-897, 923-924, 
926-927, 929, 955, 958, 984, 987, 1013-1014, 
1040, 1043, 1069, 1073, 1099, 1102, 1126-1127, 
1129, 1133, 1159, 1163, 1189-1190, 1192, 1196, 
1222-1223, 1226-1227, 1253, 1257 


Plans=47 Tests=9370 
Result: FAIL 


Spinal T AP API 


e plan(int num tests); lazy plan(); 
+ ok(int bool, char *msg,...); 

e diag(char “msg, ...); 

* skip next(char *reason,...); 


* skip block(int num tests, char *reason, ...); 


e skip(“reason”, 
ok(1, test 1”); 


Spinal T AP API 


e todo next(char *reason.,...); 


* todo block(int num tests, char *reason, ...); 


e todo(“reason”, 
ok(1,'test 1”); 


Spinal T AP API 


e eq(void “a, void *b, int(*comp)(void “a, void *b), 
char “msg, ...); 


* bail out(char “reason, ...); 


* die on fail(); restor fail(); 


+ pass(char “msg, ...); fail(char *msg....); 


Spinal TAP Extensions 


* NAME test-name 
+ output file(char *name); 


Spinal TAP Utilities 


* Prove — search for and run tests [WIP] 


* TAPdancer — TAP stream parser 
* TAPestry — history [WIP] 
* Faucet — synthetic tap generator 


Summary 


* Regression testing is an important and 
valuable software engineering practice 


* Spinal TAP provides a language and 
system agnostic testing tool for Plan 9 
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